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Abstract 

Dual-tree wavelet decompositions have recently gained much popularity, mainly due to their ability to provide an 
accurate directional analysis of images combined with a reduced redundancy. When the decomposition of a random 
process is performed - which occurs in particular when an additive noise is corrupting the signal to be analyzed - 
it is useful to characterize the statistical properties of the dual-tree wavelet coefficients of this process. As dual-tree 
decompositions constitute overcomplete frame expansions, correlation structures are introduced among the coefficients, 
even when a white noise is analyzed. In this paper, we show that it is possible to provide an accurate description 
of the covariance properties of the dual-tree coefficients of a wide-sense stationary process. The expressions of the 
(cross-)covariance sequences of the coefficients are derived in the one and two-dimensional cases. Asymptotic results 
are also provided, allowing to predict the behaviour of the second-order moments for large lag values or at coarse 
resolution. In addition, the cross-correlations between the primal and dual wavelets, which play a primary role in our 
theoretical analysis, are calculated for a number of classical wavelet families. Simulation results are finally provided 
to validate these results. 

Index Terms 

Dual-tree, wavelets, frames, Hilbert transform, filter banks, cross-correlation, covariance, random processes, 
stationarity, noise, dependence, statistics. 

I. Introduction 

The discrete wavelet transform (DWT) [1] is a powerful tool in signal processing, since it provides "efficient" 
basis representations of regular signals [2]. It nevertheless suffers from a few limitations such as aliasing effects in 
the transform domain, coefficient oscillations around singularities and a lack of shift invariance. Frames (see [3], 
[4] or [5] for a tutorial), reckoned as more general signal representations, represent an outlet for these inherent 
constraints laid on basis functions. 

C. Chaux and J.-C. Pesquet are with the Institut Gaspai'd Monge and CNRS-UMR 8049, Universite de Paiis-Est Marne-la-Vallee, 77454 
Mame-la-Vallee Cedex 2, France. E-mail: {chaux, pesquet}@univ-mlv . fr. 

L. Duval is with the Institut franjais du petrole, IFF, Technology, Computer Science and Applied Mathematics Division, 1 et 4, avenue de 
Bois-Preau F-92852 Rueil-Malmaison, France. E-mail: laurent.duval@ifp.fr. 



August 30, 201 1 



DRAFT 



IEEE TRANSACTIONS ON INFORMATION THEORY, 2007 



2 



Redundant DWTs (RDWTs) are shift-invariant non-subsampled frame extensions to the DWT. They have proved 
more error or quantization resiUent [6]-[8], at the price of an increased computational cost, especially in higher 
dimensions. They do not however take on the lack of rotation invariance or poor directionality of classical separable 
schemes. These features are particularly sensitive to image and video processing. Recently, several other types of 
frames have been proposed to incorporate more geometric features, aiming at sparser representations and improved 
robustness. Early examples of such frames are shiftable multiscale transforms or steerable pyramids [9]. To name 
a few others, there also exist contourlets [10], bandelets [11 J, curvelets [12], phaselets [13], directionlets [14] or 
other representations involving multiple dictionaries [15]. 

Two important facets need to be addressed, when resorting to the inherent frame redundancy: 

1) multiplicity: frame decompositions or reconstructions are not unique in general, 

2) correlation: transformed coefficients (and especially those related to noise) are usually correlated, in contrast 
with the classical uncorrelatedness property of the components of a white noise after an orthogonal transform. 

If the multiplicity aspect is usually recognized (and often addressed via averaging techniques [6]), the correlation 
of the transformed coefficients have not received much consideration until recently. Most of the efforts have been 
devoted to the analysis of random processes by the DWT [16]-[19]. It should be noted that early works by 
C. Houdre et al. [20], [21] consider the continuous wavelet transform of random processes, but only in a recent 
work by J. Fowler exact energetic relationships for an additive noise in the case of the non-tight RDWT have been 
provided [22]. It must be pointed out that the difficulty to characterize noise properties after a frame decomposition 
may Umit the design of sophisticated estimation methods in denoising applications. 

Fortunately, there exist redundant signal representations allowing finer noise behaviour assessment: in particular 
the dual-tree wavelet transform, based on the Hilbert transform, whose advantages in wavelet analysis have been 
recognized by several authors [23], [24]. It consists of two classical wavelet trees developed in parallel. The second 
decomposition is refered to as the "dual" of the first one, which is sometimes called the "primal" decomposition. 
The corresponding analyzing wavelets form Hilbert pairs [25, p. 198 sq]. The dual-tree wavelet transform was 
initially proposed by N. Kingsbury [26] and further investigated by I. Selesnick [27] in the dyadic case. An 
excellent overview of the topic by I. Selesnick, R. Baraniuk and N. Kingsbury is provided in [28] and an example 
of application is provided in [29]. We recently have generalized this frame decomposition to the M-band case 
(M > 2) (see [30]-[32]). In the later works, we revamped the construction of the dual basis and the pre-processing 
stage, necessary in the case of digital signal analysis [33], [34] and mandatory to accurate directional analysis 
of images, and we proposed an optimized reconstruction, thus addressing the first important facet of the resulting 
frame multiplicity. The M-band (M > 2) dual-tree wavelets prove more selective in the frequency domain than their 
dyadic counterparts, with improved directional selectivity as well. Furthermore, a larger choice of filters satisfying 
symmetry and orthogonahty properties is available. 

In this paper, we focus on the second facet, correlation, by studying the second-order statistical properties, in 
the transform domain, of a stationary random process undergoing a dual-tree M-band wavelet decomposition. In 
practice, such a random process typically models an additive noise. PreUminary comments on dual-tree coefficient 
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correlation may be found in [35]. Dependencies between the coefficients already have been exploited for dual-tree 
wavelet denoising in [36], [37]. A parametric nonlinear estimator based on Stein's principle, making explicit use of 
the correlation properties derived here, is proposed in [38]. At first, we briefly recall some properties of the dual- 
tree wavelet decomposition in Section II, refering to [32] for more detail. In Section III, we express in a general 
form the second-order moments of the noise coefficients in each tree, both in the one and two-dimensional cases. 
We also discuss the role of the post-transform — often performed on the dual-tree wavelet coefficients — with 
respect to (w.r.t.) decorrelation. In Section IV, we provide upper bounds for the decay of the correlations existing 
between pairs of primal/dual coefficients as well as an asymptotic result concerning coefficient whitening. The 
cross-correlations between primal and dual wavelets playing a key role in our analysis, their expressions are derived 
for several wavelet families in Section V. Simulation results are provided in Section VI in order to validate our 
theoretical results and better evaluate the importance of the correlations introduced by the dual-tree decomposition. 
Some final remarks are drawn in Section VII. 

Throughout the paper, the following notations will be used: Z, Z*, N, N*, M, M*, and R"^ are the set of 
integers, nonzero integers, nonnegative integers, positive integers, reals, nonzero reals, nonnegative reals and positive 
reals, respectively. Let M be an integer greater than or equal to 2, Nm — {0, . . . , M— 1} and = {1, . . . , M — 1}. 

II. M-BAND DUAL-TREE WAVELET ANALYSIS 

In this section, we recaU the basic principles of an M-band [39] dual-tree decomposition. Here, we will focus on 
ID real signals belonging to the space L^(]R) of square integrable functions. Let M be an integer greater than or 
equal to 2. An M-band multiresolution analysis of L^(]R) is defined using one scaling function (or father wavelet) 
ipo e L^(R) and (M — 1) mother wavelets Vm € L^(R), m e N^. In the frequency domain, the so-called scaling 
equations are expressed as: 

Vm e Nm, VMipmiMuj) = Hm{oj)ipo{oj), (1) 

where a denotes the Fourier transform of a function a. 

In order to generate an orthonormal A/ -band wavelet basis UmeNj^ j^zi-^~''^^'^rn{M~H — k), A: G Z} of L^(IR), 
the following para-unitarity conditions must hold: 

V(m,m') eN^^, 

M-i 27r 

Hmiuj+p—)H:^,{u;+p—)=MSm-m', (2) 

where = 1 if m = and otherwise. The filter with frequency response Hq is low-pass whereas the filters 
with frequency response H^, m e {1, . . . ,M — 2} (resp. m = M — 1) are band-pass (resp. high-pass). In this 
case, cascading the M-band para-unitary analysis and synthesis filter banks, represented by the upper structures in 
Fig. 1, aUows us to decompose and to perfectly reconstruct a given signal. 

A "dual" M-band multiresolution analysis is built by defining another M-band wavelet orthonormal basis 
associated with a scaling function and mother wavelets ^p^, m e N^. More precisely, the mother wavelets are 
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the Hilbert transforms of the "original" ones tprn, m G N^. In the Fourier domain, the desired property reads: 

Vm e N^, V'" (w) = -t sign(w)^„(w), (3) 

where sign(-) is the signum function. Then, it can be proved [31] that the dual scaling function can be chosen such 
that 

V/c G Z, Vw G [2kTT, 2{k + 1)tt), 

f 

(_l)fce-'('i+5V ^o(w) if fc > 

(4) 

(-l)*^+ie-'(''+5)" -^oCw) otherwise. 



where d is an arbitrary integer delay. The corresponding analysis/synthesis para-unitary Hilbert filter banks are 
illustrated by the lower structures in Fig. 1 . Conditions for designing the involved frequency responses G^. fn, G Nm. 
have been recently provided in [32]. As the union of two orthonormal basis decomposition, the global dual-tree 
representation corresponds to a tight frame analysis of L^(]R). 

III. Second-order moments of the noise wavelet coefficients 

In this part, we first consider the analysis of a one-dimensional, real-valued, wide-sense stationary and zero-mean 
noise n, with autocovariance function 

V(t, a;) G M^ r„(r) = E{n(a; + T)n{x)). (5) 

We then extend our results to the two-dimensional case. 

A. Expression of the covariances in the ID case 

We denote by {nj^rn[k])kez the coefficients resulting from a ID M-band wavelet decomposition of the noise, in 
a given subband (j, m) where j G Z and m G Nm- In the {j,m) subband, the wavelet coefficients generated by 
the dual decomposition are denoted by inf^^[k])kez- At resolution level j, the statistical second-order properties 
of the dual-tree wavelet decomposition of the noise are characterized as follows. 

Proposition 1: For all (m, m') G N|^, n'J^m{^]])ke2 is a wide-sense stationary vector sequence. More 

precisely, for all {£, k) we have 

E{nj,m[k + (]nj,m' [k]} = r„,,^,„ , [£] (6) 



I 

J —I 



E{nl^[k + l]nl^, [k]} = r H „ ^ [i] (7) 



-f 

J — < 



X 

r„(a;)7^H _^H^ {—-£)dx 



'Ml 

EK„[/c + £]nH [fc]} = r„_,„H m (8) 



J — oo 



August 30, 2011 



DRAFT 



IEEE TRANSACTIONS ON INFORMATION THEORY, 2007 



5 



where the deterministic cross-correlation function of two real- valued functions / and g in L^(M) is expressed as 

/oo 
f{x)g{x - t) dx. (9) 
-oo 

Proof: See Appendix I. ■ 
The classical properties of covariance/correlation functions are satisfied. In particular, since for aU m S Nm, i^m 
and V'm ^® unit norm functions, for all {m,m') £ N|^, the absolute values of 7i/;„,V'm' 71/;^, v"/ 7Vm,'/'"/ 
upper bounded by 1 . In addition, the following symmetry properties are satisfied. 

Proposition 2: For all {m,m') € Nm with m = m' = or mm' ^ 0, we have 7^h ,^h^ = 'y^,^,^^,. As a 
consequence. 



When mm' ^ 0, we have 



and, consequently. 



=r„H^,nH^,- (10) 



VreK, 7v.™,v'^,W = -7^^„V'H(-r) (11) 



w e z, r„^. ^.„H , [i] = -r ^„„h [-^]. (12) 

Besides, the function ,/,h is symmetric w.r.t. — d— 1/2, which entails that o,n"o symmetric w.r.t. d+1/2. 
Proof: See Appendix II. ■ 
As a particular case of (10) when m = m', it appears that the sequences {nj^m[k])ke2 and {nf^rn[k])kei, have 
the same autocovariance sequence. We also deduce from Prop. 2 that, for all m 0, 7^„,^h is an odd function, 
and the cross-covariance T^. ^ „h is an odd sequence. This imphes, in particular, that for all m ^ 0, 

^nj.^<nfJO]=0- (13) 

The latter equahty means that, for all m 7^ and k G Z, the random vector [nj,r„[A;] n]^^[A;]] has uncorrected 
components with equal variance. 

The previous results are applicable to an arbitrary stationary noise but the resulting expressions may be intricate 
depending on the specific form of the autocovariance r„. Subsequently, we will be mainly interested in the study 
of the dual-tree decomposition of a white noise, for which tractable expressions of the second-order statistics of the 
coefficients can be obtained. The autocovariance of n is then given by r„(a;) = 6{x), where 5 denotes the Dirac 
distribution. As the primal (resp. dual) wavelet basis is orthonormal, it can be deduced from (6)-(8) (see Appendix 
III) that, for all (m, m') G and teZ, 

Tn,,^.",,^' M = ^nfm^r^f^, [^] = ^^^Sm-m'Se (14) 
r„,,„,„H^,M, = <T%^„,^H,(-£), (15) 

where {Sk)kei. is the Kronecker sequence (^fe = 1 if fc = and otherwise). Therefore, {nj^rn[k])kGZ and 
(^^i^m[^])feez are cross-correlated zero-mean, white random sequences with variance cr^. 

The determination of the cross-covariance requires the computation of 7^„,^h . We distinguish between the 
mother (m' ^ 0) and father (m' = 0) wavelet case. 
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By using (3), for m' ^ 0, Parseval-Plancherel formula yields 

'TV'm,V'^,W = ^ J V'mM(V'm'M")*exp(za;T)cL; 



-llm 







V'm(w)(-0r„'(w))*exp(zwT)dw|, (16) 



where Iin{z} denotes the imaginary part of a complex z. 
According to (4), for m' = we find, after some simple calculations: 

<.2(fc+l)7r 



,^H(T) = -Re{^(-1)M iPmico) 



^ fe=o 



where Rc{z} denotes the real part of a complex z. 
In both cases, we have 



X (^o(w))* exp {ico + T + d)) cL;|, (17) 



1 f°° ^ 



(18) 



For M-band wavelet decompositions, selective filter banks are commonly used. Provided that this selectivity property 
is satisfied, the cross term can be expected to be close to zero and the upper bound in (18) to 

take small values when m ^ m'. This fact will be discussed in Section VI-C based on numerical results. On the 
contrary, when m = m', the cross-correlation functions always need to be evaluated more carefully. In Section V, 
we will therefore focus on the functions: 

1 f°° ^ 

7i/-„>H (r) = / |V'm(w)|^ sin(a;r) duj, m ^ 0, (19) 

^ Jo 

k=0 

/■2(fc+l)7r ^ 2 

X / |V'o(<^)P COS (w (- + T + d)) duj. (20) 



Note that, in this paper, we do not consider interscale correlations. Although expressions of the second-order 
statistics similar to the intrascale ones can be derived, sequences of wavelet coefficients defined at different resolution 
levels are generally not cross-stationary [18]. 

B. Extension to the 2D case 

We now consider the analysis of a two-dimensional noise n, which is also assumed to be real, wide-sense 
stationary with zero-mean and autocovariance function 

V(t, x) g X r„(T) = E{n(x + T)n(x)}. 

We can proceed similarly to the previous section. We denote by (nj,m[k])kez2 the coefficients resulting from a 2D 
separable M-band wavelet decomposition [39] of the noise, in a given subband (i, m) e Z x N|^. The wavelet 
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coefficients of the dual decomposition are denoted by (?ij^rn[^])kez2- We obtain expressions of the covariance fields 
similar to (6)-(8): for all j e Z, m = (mi,m2) G N^, m' = (mi,m^) e N^^, ^ = (^1,^2) G and k e I?, 

/oo ^00 ^ 
J r„(a;i,a;2)7V'mi,V'„/ [jjj - ^1) 

X TVn.^.V'^. - ^2) da;ida;2 (21) 

r„H H ,M = E{n«„[k + ^]n«„,[k]} 



r„, „,„H , M = E{n,-,„[k + ^]n«„, [k]} 

/ r„(a;i,X2)7v,„^,v,H, (v^-^j 

-ooJ —00 1 

X Tv-^^.V-^., ^ ^2) dxidx2. (23) 

From the properties of the correlation functions of the wavelets and the scaling function as given by Prop. 2, it can 
be deduced that, when (toi = m[ = or mim[ ^ 0) and {mi = = or mim'i ^ 0), 

Some additional symmetry properties are straightforwardly obtained from Prop. 2. In particular, for all m e N^, 
the cross-covariance T^. ^ „h is an even sequence. An important consequence of the latter properties concerns 
the 2 X 2 linear combination of the primal and dual wavelet coefficients which is often implemented in dual-tree 
decompositions. As explained in [31], the main advantage of such a post-processing is to better capture the directional 
features in the analyzed image. More precisely, this amounts to performing the following unitary transform of the 
detail coefficients, for m e N^: 

1 



Vk e Z2 , wj,^ [k] = — (n,-,„ [k] + nl^ [k] ) 



(25) 



wlJk] = -^(n,-,^[k] - n«„[k]). (26) 

(The transform is usually not applied when mi = or mi = 0.) The covariances of the transformed fields of noise 
coefficients (wj,m[k])kez2 and (w^jjj[k])kgz2 then take the following expressions: 

*2 ^^^^ ^ ^ 

(27) 
(28) 
(29) 



and i 


?ez2, 






r 
















r 




= 0. 
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Proof: See Appendix IV. ■ 
This shows that the post-transform not only provides a better directional analysis of the image of interest but also 
plays an important role w.r.t. the noise analysis. Indeed, it allows to completely cancel the correlations between 
the primal and dual noise coefficient fields obtained for a given value of (j, m). In turn, this operation introduces 
some spatial noise correlation in each subband. 

For a two-dimensional white noise, r„(x) = (5(x) and the coefficients ('^j,m[k])kez2 and ('^j^m'M)kez2 ^re 
such that, for all ^ = (^i, ^2) € I?, 

^"j, m' M = ^nf^,n^ , M = 0-^^mi-mi<5m2-m^<5^i^«2 (30) 



^ni^^,n^^M] = (^'^l^l>m^,i^^, (-^l)7v.„,,V>H, (-^2) . (31) 



As a consequence of Prop. 2, in the case when ^ = 0, we conclude that, for (toi 7^ or to2 / 0) and k e I?, 
the vector [nj,in[k] '^J^mlk]] has uncorrected components with equal variance. This property holds more generally 
for 2D noises with separable covariance functions. 

IV. Some asymptotic properties 

In the previous section, we have shown that the correlations of the basis functions play a prominent role in 
the determination of the second-order statistical properties of the noise coefficients. To estimate the strength of the 
dependencies between the coefficients, it is useful to determine the decay of the correlation functions. The following 
result allows to evaluate their decay. 

Proposition 4: Let (TVi, . . . , Nm-i) € (N*)^~-^ and define Nq = mmmeJ^l^ ^™-- Assume that, for all m e Nm, 
the function I'^toP is '^N^ + 1 times continuously differentiable on M and, for all q& {0, . . . , 2Nm -|- 1}, its g-th 
order derivatives (IV'mP)^*^ belong to L^(K).^ Further assume that, for all m 7^ 0, V'm('^) = 0{uj^'") as w — >■ 0. 
Then, there exists C G IR+ such that, for all m e Nm, 

Vr G R*, |7^„,^„(t)| < ^^p^^+i (32) 

and 

VreM*, |^^^_^H(r)| < ^^^fe+T- (33) 
Proof: See Appendix V. ■ 
Note that, for all m G Nm, the assumptions concerning \ijj„i\'^ are satisfied if V'm is 2Nm + 1 times continuously 
differentiable on R and, for all q <E {0, . . . , 2Nm + 1}, its g-th order derivatives V'm'' belong to L^(M). Indeed, 
if V m is 2Nm + 1 times continuously differentiable on R, so is I'^mP- Leibniz formula allows us to express its 
derivative of order q & {0, . . . , 2Nm + 1} as 



'By convention, the derivative of order of a function is the function itself 
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Consequently, if for all £ € {0, ... V'm e L^{R), then (iV^mP)*'*' e Li(R). 

Note also that, for integrable wavelets, the assumption •tpmi^^) = 0{co^'^) as w — >■ means that the wavelet i/'m, 
m ^ 0, has vanishing moments. 

Therefore, the decay rate of the wavelet correlation functions is all the more important as the Fourier transforms 
of the basis functions tpm, m G Nm. are regular {i.e. the wavelets have fast decay themselves) and the number 
of vanishing moments is large. The latter condition is useful to ensure that Hilbert transformed functions 
have regular spectra too. It must be emphasized that Prop. 4 guarantees that the asymptotic decay of the wavelet 
correlation functions is at most Irl"^^"*"^. A faster decay can be obtained in practice for some wavelet families. 
For example, when i/'m is compactly supported, 7j/,„,^„ also has a compact support. In this case however, 
cannot be compactly supported [32J, so that the bound in (33) remains of interest. Examples will be discussed in 
more detail in Section V. 

It is also worth noticing that the obtained upper bounds on the correlation functions allow us to evaluate the 
decay rate of the covariance sequences of the dual-tree wavelet coefficients of a stationary noise as expressed below. 

Proposition 5: Let n be a ID zero-mean wide-sense stationary random process. Assume that either n is a white 
noise or its autocovariance function is with exponential decay, that is there exist A e M+ and a e M+, such that 

VreM, |r„(r)| < Ae-"l^l. 

Consider also functions Vm. 'm € Nm. satisfying the assumptions of Prop. 4. Then, there exists C G IR+ such that 
for all i e Z, m e Nm and ^ e Z*, 

C 

1 + 1^ 



|rn,,...Hj^]|<YT^^- (35) 

Proof: See Appendix VI. ■ 
The decay property of the covariance sequences readily extends to the 2D case: 

Proposition 6: Let n be a 2D zero-mean wide-sense stationary random field. Assume that either n is a white 
noise or its autocovariance function is with exponential decay, that is there exist A e 1R+ and (ai,a2) € 
such that 

V(Ti,r2) e M^ |r„(Ti,r2)| < Ae-«il^il-«^l^^l. (36) 

Consider also functions tpm, ni e Nm, satisfying the assumptions of Prop. 4. Then, there exists C G M+ such that 
for all J e Z, m e N|f and £ = (£1,^2) S Z^, 
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Besides, for all j € Z, m e and £ = (£i,€2) € Z^, 



2C 



2C 

I^^^.^^MI ^ (l + |^i|2JV„ + l)(l + |^2P^™ + l)" ^^^^ 

Proof: Due to the separability of the 2D dual-tree wavelet analysis, (37) and (38) are obtained quite similarly 
to (34) and (35). The proof of (39) and (40) then follows from (27) and (28). ■ 

The two previous propositions provide upper bounds on the decay rate of the covariance sequences of the dual- 
tree wavelet coefficients, when the norm of the lag variable {i or l) takes large values. We end this section by 
providing asympotic results at coarse resolution (as j — > oo). 

Proposition 7: Let n be a ID zero-mean wide-sense stationary process with covariance function r„ e L^(K) n 
L2(M). Then, for all (m,m') G N^, we have 

lim r„. ^, {l\ = r„(0) 5m-m'k (41) 

lim r ^ ,„H , {l\ = f „ (0) ,v,H (42) 

J ^OO J' 3,171' T I'-l T ^1 

Proof: See Appendix VII. ■ 
In other words, at coarse resolution in the transform domain, a stationary noise n with arbitrary covariance function 
r„ behaves hke a white noise with spectrum density r„(0). This fact further emphasizes the interest in studying 
more precisely the dual-tree wavelet decomposition of a white noise. Note also that, by calculating higher order 
cumulants of the dual-tree wavelet coefficients and using techniques as in [18], [40], it could be proved that, for all 
(m, m') e and (fc, k') G 1?, [nj,rn(fc) ^j^m'C^')] asymptotically normal as j oo. Although Prop. 7 has 
been stated for ID random processes, we finally point out that quite similar results are obtained in the 2D case. 

V. Wavelet families examples 
For a white noise (see (14), (15), (30) and (31)) or for arbitrary wide-sense stationary noises analyzed at coarse 
resolution (cf. Prop. 7), we have seen that the cross-correlation functions between the primal and dual wavelets 
taken at integer values are the main features. In order to better evaluate the impact of the wavelet choice, we will 
now specify the expressions of these cross-correlations for different wavelet families. 

A. M-band Shannon wavelets 

M-band Shannon wavelets (also called sine wavelets in the hterature) correspond to an ideally selective analysis 
in the frequency domain. These wavelets also appear as a hmit case for many wavelet famiUes, e.g. Daubechies's 
or spline wavelets. We have then, for all m e Nm, 

V'm(w) = l]-(m+l)7r,-m7r]U[m7r,(m+l)7r[('^)) 

where Ig denotes the characteristic function of the set S C M: 

1 if w e 

ls(w) 

otherwise. 
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In this case, (20) reads: Vr € M, 



Iv-o.V-o" (^) = ^ _^ cos ((^ + d + r)w) (Lj 

' (-l)''cos (ttt) 



For m e N^, (19) leads to Vr e R, 



= < 



7r(i+d + T) 



if r ^ -d - i 



otherwise. 



(m+l)7r 



sin {ujT)duj 
' cos ((to + l)7rT) — cos(TO7rT) 



= < 



7rr 







if r ^0 
otherwise. 



We deduce from the two previous expressions that, for all ^ e Z, 



(_l)(<i+«) 



Vto^O, 

')'V'm,V'«(^) 



(-!)(' 




.+1^ 1 -(-1)^ 



if £^ 
otherwise. 



(43) 



(44) 



We can remark that, for all (m, to') e N^, 

7^„,^h(I) = (-l)(™'-™)^7^^,_^„^(£) (45) 

and (^) = 0, when i is odd. Besides, the correlation sequences decay pretty slowly as We also note 

that, as the functions '^m. fn, G Nm, have non-overlapping spectra, (6)-(8) (resp. (21)-(23)) allow us to conclude 
that, dual-tree noise wavelet coefficients corresponding respectively to subbands {j, to) and (j, to') with m ^ m' 
(resp. (i, TOi,TO2) and {j,m'i,m'2) with toi to'^ or TO2 ^ TO2) are perfectly uncorrelated. 



B. Meyer wavelets 

These wavelets [41], [42, p. 116] are also band-Umited but with smoother transitions than Shannon wavelets. 
The scaUng function is consequently defined as 



■^o(w) = < 



1 if < |a;| < 7r(l - e) 



if 7r(l-e) < |w| <7r(l-he) 



where < e < 1/(M + 1) and 



V27re 2e 
otherwise, 

V0e[O,l], W^(0) = cos gz.(0)) 



(46) 
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2e 



2neJ 



clVm (w) 



if (m — e)7r < < (m + e)7r 

if (to + e)7r < |a;| < (to + 1 — e)7r 

e^';™(")H^(' M _ if (to + 1 - e)7r < < (to + 1 + e)7r 

V ZTre 2e / 

otherwise 



(50) 



V'M-l(w) 



g»r,M-iM|4.[M — 1+i _ if (M - 1 - e)7r < Iwl < (M - 1 + e)7r 
V 2e 27re/ 

e*''"-i(") if (M - 1 + e)7r < |w| < M(l - e)7r 

v27reiW 2e / 

otherwise. 



(51) 



with 1^ : [0, 1] [0, 1] such that 

i/(0) = (47) 
V6ie[0,l], 1/(1 - 6') = 1 - 2/(6'). 

Then, it can be noticed that 

v6ie[o,i], w^{i-e) = i-w^{e). (48) 

A common choice for the u function is [42, p. 119]: 

V0G[0, 1], iy{0)=0'^ {35-840 + 70 0^ -20 6^). (49) 

For to e {1, . . . , M — 2}, the associated M-band wavelets are given by (50) while, for the last wavelet, we have 
(51). Hereabove, the phase functions rjm, tu G N^, are odd functions and we have 

Vw e (M7r,M(l + e)7r), 

?7m-i(w) = — 77M-i(2-M7r — u)) mod 27r. 
In addition, for the orthonormahty condition to be satisfied, the following recursive equations must hold: 

Vw e ((to — e)7r, (to + e)7r), 

r]m{oJ - 2rmT) - 7/^-1(0; - 2TO7r) 

= flmit^) - rim-l{oj) + TT Hiod 277. 

by setting: Vw G M, r?o(w) = 0. Generally, linear phase solutions to the previous equation are chosen [43]. 
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Using the above expressions, the cross-correlations between the Meyer basis functions and their dual counterparts 
are derived in Appendix VIII. It can be deduced from these results that: V £ e Z, 



where 



(52) 



/•l / 1 -I- ^ \ 

For the wavelets, we have when me{l,...,M — 2}: 



otherwise 



(54) 



whereas 

7i/;m-i,Vm_i(^) ~ 

'"'^ (55) 
otherwise. 

Similarly to Shannon wavelets, for (m, m') e {1, . . . , M — 2}^, (45) holds and 7^„>h (£) = 0, when I is odd. As 
expected, we observe that the previous cross-correlations converge point-wise to the expressions given for Shannon 
wavelets in (43) and (44), as we let e ^ 0. 

Besides, let us make the following assumption: W"^ is 25-1-2 times continuously differentiable on [0, 1] with 
g e N* and, for all ^ e {0, . . . , 2g — 1}, {W'^)^^\l) = 0. This assumption is typically satisfied by the window 
defined by (49) with g = 4. From (48), it can be further noticed that, for alH e {1, . . . , 1}, {W^)^'^^^{l/2) = 0. 
Then, when x 7^ 0, it is readily checked by integrating by part that 



r ( ^-^) sin (Trea;^) dO = 
Jo \ 2 J ^ ' 2-nex 



229(7rea;)29+i ^ ^ 

229+1 (7rex)2'?+2 ^ 



^ (-1)^+1 



229+2 (7rea;)29+2 



This shows that, as \x\ 00, 

i^(-) = -+ ;2.iw2:;;.2;.2;:/ ^^si^ex) + o{x--^--). (56) 



TTX 229-l7r29+le29a:29+l 

For example, for the taper function defined by (49), we get 



^ , , 1 385875 , , _ , _io^ 

h{x) = . - „ q cos(7rea;) + 0{x ^°). 

TTX An^e^x^ 
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Combining (56) with (52), (54) and (55) allows us to see that the cross-correlation sequences decay as ^-^g-i 
when 1^1 — 00. Eq. (56) also indicates that the decay tends to be faster when e is large, which is consistent with 
intuition since the basis functions are then better localized in time. Note that, as shown by (50) and (51), under the 
considered differentiabiUty assumptions, ItAmP is 2g — 1 times continuously differentiable on K whereas V'm(w) = 
for m e and |w| < m — e. Prop. 4 then guarantees a decay rate at least equal to (here, Nm = g — 1). 

In this case, we see that the decay rate derived from (56) is more acurate than the decay given by Prop. 4. 

C. Wavelet families derived from wavelet packets 

1) General form: One can generate M-band orthonormal wavelet bases from dyadic orthonormal wavelet packet 
decompositions corresponding to an equal subband analysis. We are consequently limited to scaling factors M 
which are power of 2. More precisely, let (V'm)meN be the considered wavelet packets [44], for all P G N* an 
orthonormal M-band wavelet decomposition is obtained using the basis functions {ipm)o<m<M with M = 2^. In 
this case, the basis functions satisfy the following two-scale relations: for all m G N, 

\/2V^2m(2w) = Ao(w)V^™(w) (57) 
V2ip2m+i{2co) = Ai{uj)iim{c^), (58) 

where Aq and Ai are the frequency responses of the low-pass and high-pass filters of the associated two-band 
para-unitary synthesis filter bank. We can infer the following result. 
Proposition 8: For all r e M and m € N*, we have 

OO 

+ Yl '^«o [k] (7v.„,^H (2t + k)+ 7^^,^H (2t - fc)) (59) 

k=l 

oo 

+ X! [^] ('^V'™ , V« (2^ + fc) + Ti/-^ , v« (2^ - fc)) , (60) 

where, for all e e {0, 1}, (7oe[^])/cez is the autocorrelation of the impulse response (ae[fc])/sez of the filter with 
frequency response A^: 

oo 

VfceZ, 7aeW= aMae[q-k]. 

q— — oc 

Proof: See Appendix IX. ■ 
It is important to note that (59) and (60) are not valid for m = 0. These two relations define recursive equations 
for the calculation of the cross-correlations (7v>,„,V'^)'n>i. provided that 7^i,^h has been calculated first. 

For this specific class of M-band wavelet decompositions, it is possible to relate the decay properties of the 
cross-correlation functions to the number of vanishing moments of the underlying dyadic wavelet analysis. 

Proposition 9: Assume that the filters with frequency response Aq and Ai are FIR and Ai has a zero of order 
AT e N* at frequency (or, equivalently, Aq has a zero of order A'' at frequency 1/2). Then, there exists Co e R+ 
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such that 

Vr G K*, |7v,„,<(t)| < Co|r|-2^-^ (61) 

In addition, for all m e N*, let (ei, e2, • • ■ , Cr) S {0, 1}'', r e N*, be the digits in the binary representation of m, 
that is 

r 

m = ^ei2*-^ (62) 

Then, there exists Cm € 1R+ such that 

Vr e K*, |7,,„.^,H (r)| < ajrr^A^^^r.. ^O-i. (63) 
Proof: The filters of the underlying dyadic multiresolution being FIR (Finite Impulse Response), the wavelet 
packets are compactly supported. Consequently, their Fourier transforms are infinitely differentiable, their derivatives 
of any order belonging to L^(]R). In addition, the binary representation of m G N* being given by (62), Eqs. (57) 
and (58) yield 

that is Hm{uj) = Dili (2^"*'^)- Moreover, by assumption Ai{uj) ~ O(w^) as a; ^ 0, whereas Ao{0) = \f2 
and |V'o(0)| = 1. This shows that, when m 7^ 0, V'rn(w) = 0(w^^^^^=i '^■^) as w 0. From (33), we deduce the 
upper bound in (63). Furthermore, by applying Prop. 4 when M = 2, we have then Nq = Ni = N and (61) is 
obtained. ■ 
We see that the cross-correlation 7i/,„,^h decays all the more rapidly as the number of I's in the binary representation 
of m is large.^ 

2) The particular case ofWalsh-Hadamard transform: The case M = 2 corresponds to Haar wavelets. In contrast 
with Shannon wavelets, these wavelets lay emphasis on time/spatial localization. We consequently have: 

■^o(w) = sinc(^) e"*t (64) 

^1(0;) = I sinc(^) sin(^) cr'^ , (65) 



where 

' sin(a;) 



if w ^ 



1 otherwise. 



sinc(ci;) 

After some calculations which are provided in Appendix X, we obtain for all t G M, 

00 



fc=0 



- Sk{l + 2rf + 2t) + ^ Sk{-1 + 2d + 2t)) , (66) 



^The characterization of the sum of digits of integers remains an open problem in number theory [45], [46]. 
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where, for all fc € N and for all a; e M, 

Sk{x) = X / sinc(u) du. 

Furthermore, we have (adopting the convention: ln(0) = 0): 

^^l^„^|,f{r)=^r\n\T\ + (T + l)ln|T + l| + (T-l)ln|T-l| 

-4(.+ i)ln 

For M — 2^ with P > 1, the cross-correlations 7^^^^h , m E {2, . . . , 2^ — 1}, can be determined in a recursive 
manner thanks to Prop. 8. For Walsh-Hadamard wavelets, we have 



"+2 



4(r-i)ln 



1 

"-2 



• (67) 



Vee{0,l}, VfceZ, 7aeW= < 



1 



if A; = 



if = 1 



otherwise 



(68) 



and, consequently, for all m 7^ and r e M, 



+ I (7v.„.>« (2t + 1) + 7^„,v.« (2r - 1)) (69) 



- I (7^™,^^ (2^ + 1) + "f^rr^i^^ (2^ - 1)) • (70) 



From (67), it can be noticed that 7^i,^h(t) = l/(87rr^) + 0(t~^) when |r| > 2, which corresponds to a faster 
asymptotic decay than with Shannon wavelets. The asymptotic behaviour of 7v;„,V'Ji (''")' 'ti > 2, can also be deduced 
from (67), (69) and (70). The expressions given in Table I are in perfect agreement with the decay rates predicted 
by Prop. 9. 



D. Franklin wavelets 

Franklin wavelets [47], [48] correspond to a dyadic orthonormal basis of sphne wavelets of order 1 [42, p. 146 
sq.]. With the Haar wavelet, they form a special case of Battle-Lemarie wavelets [49], [50]. The Fourier transforms 
of the scahng function and the mother wavelet are given by: 



V'i(w) 



1/2 



sine 



(I) 



l + 2cos2(w/2) 

/ 3(l + 2sin2(a;/4)) 

i^(l-|-2cos2(w/2))(l + 2cos2(w/4)) 

xsm (^^jsinc j exp (-z-). 



(71) 



1/2 



(72) 
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The expression of the cross-correlation of the scaling functions readily follows from (20): 

Vr e R, 7v.o,^« W = - E(-l)'^'^(l + + 2r), 



Th[x)= / — — cos(ua;) dw. 



where, for all A; e N and a; e M, 

/fe^ l + 2cos2(«) 

The expression of the cross-correlation of the mother wavelet can be deduced from (19) and (72) and resorting to 
numerical methods for the computation of the resulting integral, but it is also possible to obtain a series expansion 
of the cross-correlation as shown next. 

Taking the square modulus of (72), we find 

2|V^i(2a;)p = (73) 

where 

~ / 6(2-cosH) \ "'^ 

^ ' 1(1 + 2cos2(u;))(2 + cos(a;)) j ' 

) 

Let (ai[fc])feez (resp. x) be the sequence (resp. function) whose Fourier transform is A\ (resp. x). Similarly to 
(60), (73) leads to the following relation 

Vr e M, 7v,. (r) = 75^ [0] 7x,x" (2^) 

00 

+ 13 75i W (7x,x« (2^ + ^) + 7x,x« (2^ " ^)) , (74) 
fe=i 

where (75i[A;])fe£z denotes the autocorrelation of the sequence (ai[fc])fcez- 

We have then to determine 7x,xH (7ai ['f'])feeN- First, it can be shown (see Appendix XI for more detail) that 

37r7^,;^H(r) = qot^ In |r| 

4 

+ H 9p ((^ + P)^ In k + p| + (r - p)3 In |t - p|) , (75) 
p=i 

where 

35 7 7 1 1 

«° = ~16' ^^ = 4' ^' = ~8' ^'=4' *^ = ~32- 

Secondly, the sequence (75i[A;])fc£N can be deduced from by using ^-transform inversion techniques 

(calculations are provided in Appendix XI). This leads to Vfc e N, 

-faAm = ^(2 - ^/3)^(7(-l)'= + 4(2 - v^)'=) 

8 ^^^^ 

7s, [2/c + 1] = ^(2 - V3)'= ((-1)'=(1 - ^) - (2 - ^3)"+'). 
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Equations (74), (75) and (76) thus allow an accurate numerical evaluation of 7i/,i,i/,h 

7x,xh(t) ~ -3/(27rT^) as |r| oo 



,H. Since 



(77) 



and 



7ajfc] = 0((2 - x/3)'=/2) 



as fc ^ oo 



(78) 



the convergence of the series in (74) is indeed pretty fast. 



From Prop. 4, we further deduce that 7^/^^^ ip^fi''') '^'^'^ 7i/'i 4'fi''') decay as |r| ^ (here, we have Nq = Ni = 2). 



The decay rate of 7^1, can be derived more precisely from (74). Indeed, we have 



00 



rf E \ysMhx,x^{2T - k)\ 



k— — oo 



<2 E \l~aAk]mr-kf + \kf)\j^,^u{2r-k)\ 



k— — oo 



00 



< (sup(|«n7^,^H(«)|)+sup|7;,,^H(u)|) E {l + mTaAk]\ 




< 00 



(79) 



where the convexity of |.|^ has been used in the first inequality and the last inequality is a consequence of (77) 
and (78). It can be deduced from the dominated convergence theorem that 



1 

~~ 32^' 

Finally, we would Uke to note that similar expressions can be derived for higher order spline wavelets although the 
calculations become tedious. 



A. Results based on theoretical expressions 

At first, we provide numerical evaluations of the expressions of the cross-correlation sequences obtained in the 
previous section when the lag variable (denoted by t) varies in {0, 1, 2, 3}. The cross-correlations for lag values in 
{—3, —2, —1} can be deduced from the symmetry properties shown in Section III-A. We notice that cubic spline 
wavelets [51] have not been studied in Section V, so that the their cross-correlation values have to be computed 
directly from (19) and (20). The results concerning the dyadic case are given in Table II. They show that the 
cross-correlations between the noise coefficients at the output of a dual-tree analysis can take significant values 
(up to 0.64). We also observe that the wavelet choice has a clear influence on the magnitude of the correlations. 
Indeed, while Meyer wavelet leads to results close to the Shannon wavelet, the correlations are weaker for the Haar 
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wavelet. As expected, spline wavelets yield intermediate cross-correlation values between the Meyer and the Haar 
cases. 

Our next results concern the M-band case with M > 3. Due to the properties of the cross-correlations, the study 
can be simplified as explained below. 

• Shannon wavelets: due to (45), the M-band cross-correlations are, up to a possible sign change, equal to the 
dyadic case cross-correlations (see Table II). 

• Meyer wavelets: still due to (45), the first M — 2 cross-correlations of the wavelets are easily deduced from 
the first one. So, we only need to specify 7^q,^h, 7^j^^h and 7^jj,^_j.^h^ ^. Tables III and IV give the related 
values when M ranges from 3 to 8, the e parameter being set to its possible maximum value [M + 1)^^. 

• Walsh-Hadamard wavelets: when M — 2^+^, P € N*, (■i/'m)o<m<M/2 is the set of basis functions of the 
(A'//2)-band wavelet decomposition. In this way, the results in Table V allow us to evaluate the cross-correlation 
values for M e {2,4,8}. 

As shown in Tables III and IV, the cross-correlations in the Meyer case remain significant, their magnitudes being 
even slightly increased as the number of subbands becomes larger. Table V shows that the cross-correlation of 
Walsh-Hadamard wavelets are much smaller and that they are close to zero when the subband index m is large. 

B. Monte Carlo simulations 

A second approach for computing the cross-correlations consists in carrying out a Monte Carlo study. More 
precisely, a realization of a white standard Gaussian noise sequence of length L = M-^ljp-\ (with J = 3) is 
drawn and its ID dual-tree decomposition over J resolution levels is performed. Then, the cross-covariances for 
each subband can be estimated by their classical sample estimates. In our experiments, average values of these 
cross-correlations are computed over 100 runs. 

This Monte Carlo study allows us to vaUdate the theoretical expressions we have obtained for several wavelet 
families in Section V. In addition, this approach can be applied to wavelets whose Fourier transforms do not take 
a simple form. For instance, we are able to compute the cross-correlation values for symlets [42][p.259] associated 
to filters of length 8 as well as for 4-band compactly supported wavelets (here designated as AC) associated to 
16-tap filters [52]. 

Table VI shows the estimations of the cross-correlations obtained in the dyadic case, while the results in the M-band 
case with M > 3 are Usted in Tables VII and VIII. By comparing these results with the ones in Tables V, III and 
IV, a good agreement is observed between the theoretical values and the estimated ones for Shannon, Meyer and 
cubic spline wavelets. For less regular wavelets such as Franklin or Haar wavelets, the agreement remains quite 
good at coarse resolution (j = 3) but, at fine resolution (j = 1), it appears that the correlations are stronger in 
practice than predicted by the theory. The fact that we use a discrete decomposition instead of the classical analog 
wavelet framework may account for these differences. Indeed, we use the implementation of the M-band dual-tree 
decomposition described in [32], which requires some digital prefilters. The selectivity of these filters is inherited 
from the frequency selectivity of the scaling function. As a side effect, the noise is colored by these prefilters. 
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Some comments can also be made concerning symlets 8 and 4-band AC wavelets. We see that the symlets behave 
very similarly to FrankUn wavelets whereas AC wavelets provide intermediate correlation magnitudes between the 
M-band Meyer and Hadamard cases. 

C. Inter-band cross-correlations 

Although the cross-correlations between primal/dual basis functions corresponding to different subbands have 
not been much investigated in the previous sections, we provide in this part some numerical evaluations for them. 
More precisely, we are interested in studying (7^^ ,{C^)ie'L with m, 7^ m', which represents the inter-band cross- 
correlations. We are able to compute them thanks to (16) and (17). Numerical results are given in Table IX. 
Some symmetry properties can be observed, which can be deduced from (16), (17) and the specific form of 
the considered wavelet functions. Most interestingly, it can be noticed that the inter-band cross-correlations often 
have a significantly smaller amplitude than the corresponding intra-band cross-correlations. As expected, the more 
frequency- selective the decomposition filters, the more negUgible the values of the inter-band cross-correlations. 

D. Two-dimensional experiment 

We aim here at comparing the obtained theoretical expressions of the two-dimensional cross-covariances with 
Monte Carlo evaluations of these second-order statistics. We consider a two-dimensional 3-band Meyer dual-tree 
wavelet decomposition of a white standard Gaussian field of size 756 x 756. The Monte Carlo study is carried out 
over 10000 realizations. The decomposition is performed over J — 2 resolution levels and the results are provided at 
the coarsest resolution. The covariance fields are depicted in Fig. 2 as well as the ones derived from (31), (52)-(55). 
For more readibility, a dashed separation line between the subbands has been added (for a 3-band decomposition, 
9 covariance fields (r„^. ^ „h [£])g^2,'^ have to be computed when m e {0,1,2}^). We compute these fields for 
i e {0, 1, 2, 3}^, thus resulting in 16 covariance values for each subband. Succinctly, each small gray-scaled square 
represents the intensity of the cross-covariance in a given subband m at spatial position £. Comparing theoretical 
results with numerical ones (left and right sides of Fig. 2, respectively), it can be noticed that they are quite similar. 
In addition, we observe that, due to the separability of the covariance fields and (13), for all m = {mi,m2) and 
£ = {£1,12), (r„_. ^ „H [^])^ez2 vanishes when either (mi 7^ and ii = 0) or (7712 7^ and £2 = 0). 

VII. Conclusion 

In this paper, we have investigated the covariance properties of the M-band dual-tree wavelet coefficients of wide- 
sense stationary ID and 2D random processes. We have stated a number of results helping to better understand 
the structure of the correlations introduced by this frame decomposition. These results may be useful in the design 
of efficient denoising rules using dual-tree wavelet decompositions, when the noise is additive and stationary. In 
particular, if a pointwise estimator is applied to the pair of primal/dual coefficients at the same location and in the 
same subband, we have seen that the related components of the noise are uncorrected. On the contrary, if a block- 
based estimator is used to take advantage of some spatial neighborhood of the primal and dual coefficients around 
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some given position in a subband, noise correlations generally must be taken into account. Recently, this fact has 
been exploited in the design of an efficient image denoising method using Stein's principle, yielding state-of-the-art 
performance for multichannel image denoising [38], [53]. In future work, it would be interesting to extend our 
analysis to other classes of random processes. In particular, a similar study could be undertaken for self-similar 
processes [54], [55] and processes with stationary increments [21], [56]. 

Finally, we would like to note that the expressions of the cross-correlations between the primal and dual wavelets 
which have been derived in this paper may be of interest for other problems. Indeed, let 

D 

denote the dual-tree wavelet decomposition where D (resp. D^) is the primal (resp. dual) wavelet decomposition. 
The studied cross-correlations then characterize the "off-diagonal" terms of the operator 

I D{D^y 
D^D* I 

where A* denotes the adjoint of a bounded linear operator A. The operator TT* is encountered in the solution of 
some inverse problems. 



Appendix I 
Proof of Proposition 1 

The M-band wavelet coefficients of the noise are given by 

Vm e NM,Vfc e Z, 



1 



(x) — -TT^i^mi-TT^ — k) dx 



nUk] = y_ n{x) ^^(^ - k) dx. 
For all (m, m') G and (k, k') G I?, we have then 

E{nj^rn[k]nj^rn'[k']} = I / E{n{x)n{x')} 



OO *f —OO 



After the variable change r = a; — x', using the definition of the autocovariance of the noise in (5), we find that 

/oo 
-oo 

k')dx]dT 



which readily yields 



--{nj,m[k]nj,m'[k']} = J r„(T)7^^,^^, ij^+k'-k) dr. 
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Note that, in the above derivations, permutations of the integral symbols/expectation have been performed. For these 
operations to be vaUd, some technical conditions are required. For example, Fubini's theorem [57, p. 164] can be 
invoked provided that 

^\n\iT-h\i^„\,\i^^,\{j^ + k' -k)dT< 00, 



where r|„| is the autocovariance of \n\. 

Relations (7) and (8) follow from similar arguments. 



Appendix II 
Proof of Proposition 2 

For all (m, m') e N|f , Vr e K, 



1 r°° 



271- „ 

Since the Fourier transform defines an isometry on L^(R), it can be deduced from (80) that j^h ^,h^ is in L^(M) 
and its Fourier transform is a; n- ^^^{uj) {^tp^^, {u}))* . According to (3) and (4), when m = m' = or mm' =^ 0, 
the latter function is equal to w i-)- V'in(w)(V'm'(w))*, thus showing that 7^h ,^h^ = 7,/,^,^^,. The equality of the 
covariance sequences defined by (6) and (7) straightforwardly follows. 

When mm' ^ 0, the Fourier transform of 7^^^^h^ is equal to w zsign(w)V'm('^)V'm'('^) whose conjuguate 
is the Fourier transform of —lip^,,^!^- This proves (11), which combined with (8) leads to 



dx. 



After a variable change and using the fact that r„ is an even function, we obtain (12). 

Consider now the Fourier transform uj t-^ 7/;o(ci;)(V^(w))* of 7^o_^h. For all w > 0, there exists fc e N such as 
CO e p/cTT, 2(fc + l)7r) and, from (4), we get 

For symmetry reasons, the equality between the first and last terms extends to all a; € M. Coming back to the time 
domain, we find 

Vr e R, 7v.o,Vo"M = ^V-o.V-?!-^ - - !)• 
3 As {iJ^,{t -k),k€ Z} is an orthonormal family of L2(R), we have < 1 and G L'^{R). 
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This shows the symmetry of 7^0, w.r.t. —d — 1/2. Eq. (8) then yields 

K,,o,nfJi] = r„(a;)7^„,v,H (-^ +i-2d-l)dx 



-00 



/oo 
^ r„(a;)7v,„,^H (^^+£-2d-l)dx 

= r„^,o,<oH + 2rf + i]. 



Appendix 111 
White noise case 

Recall that a white noise is not a process with finite variance, but a generalized random process [58], [59]. As such, 
some caution must be taken in the application of (6)-(8). More precisely, if n is a white noise, its autocovariance 
can be viewed as the limit as e > tends to of 

r„.(r) = -^exp(-^), rem. 

Formula (8) can then be used, yielding for all (m,m') e and {j,tj G I?, 

Since tl)m and Vm' L^(]R), lip^,^^, is a bounded continuous function. By applying Lebesgue dominated 

convergence theorem, we deduce that 



= [ , — exp {—'—) lim 7,,, ,/,h f — £^ 
J-00 V27r 2 



which leads to (15). Equations (14) are similarly obtained by further noticing that, due to the orthonormality 
property, 'y,p^,^^,{-i) = j^H^^H^{-i) = 5m-m'5i- 

Appendix IV 
Proof of Proposition 3 

From (25) and (26) defining the unitary transform applied to the detail noise coefficients (Tij,m[k])kez2 and 
«m[k])kez=: 

E{«;j,m[k]wj-m[k']} = 

i(E{n,-„[k]n,-^[k']} + E{n,-„[k]n»„[k']} 
+ E{n«„[k]n,-,„[k']} + E{<„[k]n«^[k']}). 
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Using (24) and the evenness of T^. ^ „h , one can easily deduce (27). Concerning (28), we proceed in the same 



way, taking into account the relation: 



i(E{n,-,™[k]n,-,„[k']} - E{n,-,„[k]n«„[k']} 
- E{n«^[k]n,- ™[k']} + E{nH^[k]nH^[k']}). 



Finally, noting that 



E{wj,^[k]wfM = 

l(E{n,-„,[k]n,,„[k']} - E{n,-^[k]nH^[k']} 

+ E{n«^[k]n,-,^[k']} - E{n«„[k]n»„[k']}) 

and, invoking the same arguments, we see that Wj,i„[k] and uncorrected random variables. 

Appendix V 
Proof of Proposition 4 

Since ipm € L^(R), we have 
Vr eM, 

1 f°° ^ 

Furthermore, \'tpm\'^ is "^Nm + 1 times continuously differentiable and for all q G {0, . . . , 2Nm + 1}, (IV'toP)*-'^'' S 
Li(]R). It can be deduced [60][p. 158-159] that 

Vr eR, 



1 r°° ^ 



which leads to 

Vr eM, 



Let us now consider the cross-correlation functions 7^^,^h with m 7^ 0. Similarly, when m ^ 0, we have 



Vre 



1 /"^ 

7v^,V.«W = ^y aM|^,„(a;)|V""da;, (81) 
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where a{ui) = zsign(w). The function w (->• a{u)\'ipm{^^)\'^ is 2Nm + 1 times continuously differentiable on K*, 
where its derivative of order g € {0, . . . , 2Nm + 1} is 

(a|V^„n(9) =a(|V^„n(9). (82) 

Due to the fact that \i^m{co)\'^ = ©(w^at^) as w ^- 0, we have for all g e {0, . . . , 2Nm - 1}, (|^„j|2)(«)(0) = 0. 
From (82), we deduce that the function (a|^TOp)^'^ admits Umits on the left side and on the right side of 0, which 
are both equal to 0. This allows to conclude that a|^m|^ is 2Nm — 1 times continuously differentiable on R, its 
2Nm — 1 first derivatives vanishing at 0. Besides, (al'^ml^)^^^'""^' is continuously differentiable on (— oo,0] and 
on [0, oo) ((alV'mP)^^^'"' may be discontinuous at 0). Using the same arguments as for 7v>m,j/'m' this allows us to 
claim that 

Vr e M, 

1 f°° ^ 

1 r°° ^ 

= — i\i^m\')^^''-\uj)smiu;T)duj. (83) 

We can note that lim^^<^(|V^„|2)(2JV„.)(^) g R as it is equal to (|V^™P)^'^'"^(0) + {\iim\^)^^^'-+^Hiy) dp 
where (|^mP)+^"*Ho) denotes the right-hand side derivative of order 27V„ of \^rn\'^ at 0. Since (|^m|^)^^^'"-' e 
L^([0, oo)), the previous limit is necessarily zero. Using this fact and integrating by part in (83), we find that, for 
all r e R, 



Jo 



Combining this expression with (83), we deduce that 



POO 

■ / (|V^™|')('^"'+'Ha;)cos(a;r)rfa;. 
Jo 



Vre 



+ 



Kiv^^nr-^wi)- (84) 



Let us now study the case when m = 0. Eq. (81) still holds, but as shown by (4), a takes a more complicated 
form: 



Vfc e Z, Vw e [2A;7r,2(A; + l)7r), 



a{oj) 



{-l)ke^id+^)uj if A; > 
(-l)'^+ie<''+5V otherwise. 
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So, the function a as well as its derivatives of any order now exhibit discontinuities at 2A;7r where A; € Z*. However, 
from (1) and the low-pass condition V'o(O) = 1, we have, for all mj^O, 

= 0(w^'"), asw-s-O. 

As a consequence of the para-unitary condition (2), we get 

M-l 



and 



which allows to deduce that 



m=0 
M-l 

M 



p=0 



27r 

VpeN^, Ho{u:+p—) = Oico''°). 

From (1), it can be concluded that 

Vfc € Z*, '0o(w + 2fc7r) = 0{lu^"), as w -S^ 0. (85) 
The derivatives of order q € {0,..., 2No + 1} of a|^oP over M \ {2fc7r, /c e Z*} are given by 

where 

VA; e Z, Vw e (2fc7r, 2(fc + l)7r), 

i)^ e*('^+^)" iffc>0 
+ i)« e^'^+iV otherwise. 

We deduce that, for all g e {0, . . . , 2No + 1}, {a\i;o?)^''^ e L^{R). Furthermore, combining (85) with (86) allows 
us to show that, for all g' e {0, . . . ,2No — 1}, the derivative of order q of ajV'oP at 2k'jT, k G Z*, is defined 
and equal to 0. Consequently, alt/jol^ is 2N(, — 1 times continuously differentiable on M while (a|V'o|^)'^^''~^^ is 
continuously differentiable on Ufcez(2fc7r, 2{k + l)7r). Similarly to the case m ^ 0, this leads to 

Vr e R, 

= ^ E / (a|V^on(''^°H'^)e^""rf'^- (86) 



fc= — oo 



August 30, 2011 



DRAFT 



IEEE TRANSACTIONS ON INFORMATION THEORY, 2007 



27 



By integration by part, we deduce that 

VreM, 



{a\$of)^^^°^^\io)e'^'duj + l3') (87) 
P=Y1 ((«IV^or)r°^(2M - {a\M't''°\2kn)) e'^-^^, (88) 



fcez 

where (a|?/^oP)+''^°^(wo) (resp. {a\->po\'^)-^°\^o)) denotes the right-side (resp. left-side) derivative of order 2No 



of a|V'o| at Wo e M. We conclude that 



VreM, |r|2^o+i| (^)i 



1 

2^ 



\{a\^o\^)^^''°+'\Lo)\dLo + \p\). (89) 



In summary, we have proved that (32) and (33) hold, the constant C being chosen equal to the maximum value of 
the left-hand side terms in the inequalities (80), (84) and (89). 

Appendix VI 
Proof of Proposition 5 

Let m e Nm- Since Vm is a unit norm function of L^(M), the function 7^„,^h is upper bounded by 1. As 
'T'/'m.V'm farther satisfies (33), it can be deduced that 

Vr e M, |7^„,^H (r)| < (90) 

The same upper bound holds for 7j;>„.i/Jm- 

For a white noise, the property then appears as a straightforward consequence of the latter inequality and Eqs. (14) 
and (15). 

Let us next turn our attention to processes with exponentially decaying covariance sequences. From (8), (34) and 
(90), we deduce that 



/oo 
-oo ^ 



g-a|x| 



■dx. (91) 



+ \M-^X - ^|2JVm + l 

As the left-hand side of (91) corresponds to an even function of i, without loss of generality, it can be assumed 

'^The series in (88) is convergent since all the other terms in (87) are finite. 
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that £>0. We can decompose the above integral as 



1 + |M-JX - ^|2Wm + l 



dx 



"io T 



+ {M-OX+e)'^^rn + i 



dx 



1 + |M-Ja;-£|2^'"+i 



dx . 



The first integral in the right-hand side can be upper bounded as follows 

1 + {M-ix + £)2JV™+i "-^ 

< (1 + £2JV„ + 1)-1 /'"e-aa^rfa. 

Jo 

Let e G (0, 1) be given. The second integral can be decomposed as 

■ dx 

dx 



a-l(l + £2M)-l. 



l + |M-Jx-£|2^™+i 

eMH 







1 + (£ - M-Jx)2^m+1 



Furthermore, we have 



dx 



1 + - M-Ja;)2JV^+i 

< (1 + (1 - e)2iV™+1^2JV^ + l)-l / g-ax 

<a-^(l-e)-2^--i(l+£2^"+i)-i (92) 



POO 

J eMH 1 



+ |M-Jx - £|2JV„.+1 



/ 



From the above inequalities, we obtain 

\Tn,,^,nlM < ^(1 + C)a-'{{1 + (1 - e)-2^'"-i) 

X (i + £2iv^+i)-i + e— ^^^). 

As lim^^oo(l + ^2iv„+i-)e-«^^^^ = 0, it readily follows that there exists C gR+ such that (35) holds. 

The left-hand side of (91) being also an upper bound for |r„^^^„^^ 0, (34) is proved at the same time. 
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Appendix VII 
Proof of Proposition 7 

Let us prove (42), the proof of (41) being quite similar. We first note that ^mii^i')* and therefore 7^, 
belong to L^(M) (see footnote 3). Applying Parseval's equaUty to (8), we obtain for all £ S Z, 

As r„ e L^(M), the spectrum density r„ is a bounded continuous function. According to Lebesgue dominated 
convergence theorem, 

lim r„^^_„H \i\ 

/oo 
-00 



r„(o) 



27r ._oo 

Appendix VIII 
Cross-correlations for Meyer wavelets 



Substituting (46) in (20), we obtain, for all t G M, 



7v,o,V?W=-n cos(^w(d+-+r)jda; 



=(1 - e)sinc(7r(l -e){d+^+ r)) 
+ey" W2j^ii^)cos(7r(e0 + l)(d+i+T))d0. (93) 



Using (48), we get 

rO 



J 1 (^) (''^'^ + 1) ('^ + ^ + ^)) 

= ^ cos(7r(e^-l)(rf+i+r)) 



de 



This allows us to rewrite (93) as 

7v-o,^^ W = sinc(7r(d sin (7r(d + ^ 



~/ M^^(^-^)cos(7r(e6i-l)((i+i+T))d6'. (94) 



x/,(rf+i+T). (95) 
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After simplification, (52) follows. 

According to (19) and (50), we have for all m e {1, . . . , M - 2} and r € M*, 



/ W^i sm(iJT)(ko 

/•TT (m+1 — e) 

+ / sin(ujr)duj 

J -7r(m+e) 

cos (7r(m + 1 — e)T) — cos (7r(m + e)r) 
7rr 

+ Ty2j^^^)sin(7r(e6'-m)r)d6l 

/I / 1 -h ^ \ 

(— ^) sin (7r(e6' + m + l)r) ^6*. 

By proceeding similarly to (93)-(94), we find 

7^^_^H (r) = (cos(7r(m + 1)t) - cos(7rmT)) {^-^ - /^(t)^ . 

When T is an integer, this expression further simplifies in (54). 
Finally, when m = M — 1, we have, for all r S M*, 

= / — sm(wT)dw 

/■7rM(l-e) 

+ / sin(wr)(ia; 

i7r(M-l+e) 

.7rM(l+e) 1 - f \ \ 

+ / - ^) sm{wT)duj) 

Am(i^O V27reM 26^ ^ ^ 7 

cos {■jtM{1 - e)r) - cos (7r(M - 1 + e)r) 



(i6» 



+ ej (^y^) sin (7r(e6' - M + 1)t 

- eM y (^-^) sin (7rM(e6' + l)T)d6» 

cos (ttMt) - cos (7r(M - l)r) , , ^ n . ^ 

: !^ '- ^ + cos (7r(M - 1)t)I,{t) 

TTT 

— C0s(7rMT)/Me(''")- 



This yields (55). 
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Appendix IX 
Proof of Proposition 8 



Let m G N*. Given (19), (57) leads to 



-^')'V'2m,V'?^('^) = / IV'2m(w)|^ sin(a;r) (ko 

J 

poo 

= |Ao(w)nV^„(w)|2 sin(2wT) (96) 
Jo 



Furthermore, we have 



|Ao(a;)p = ^ 7a JA;] exp(-ifca;) 

k 

oo 

= 7ao[0]+2 5^7„Jfc] cos(M- 



fe=l 

Combining this equation with (96) and using classical trigonometric equalities, we obtain 



J 

poo 

+ y"7ao[fc]( / |V'm(w)|^sin((2T-fc)w)dw 

fe=l ^-^0 



/■oo ^ 

/ \^m{^y^ sin ((2r + k)uj)duj 



poo 

+ 



which, again invoking Relation (19), yields (59). Eq. (60) can be proved similarly starting from (58). 

Appendix X 
Cross-correlations for Haar wavelet 

Knowing the expression of the Fourier transform of the Haar scaling function in (64) and using the cross- 
correlation formula (20), we obtain: 



^ oo /.2(fe+l)7r ^ 

= - y^(-l)'' / sinc^(-) cos (uj (- + T + d)) dw 

= ± ^(-1)'= / ^^^4^ cos [u (1 + 2r + 2d)) dv. 

i._n Jkw ^ 



(97) 

fe=0 
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By integration by part, we find: for all (a, /3, r]) e 



cos{r]uj)du) 



I 

J a 

sin^(a) cos(rya) sin^(/3) cos(?7^) 
" a ^ 

1 sin ((2 + r])uj) , r/ smirjco) , 

1(2-,)/"°""^,:"'")^. 

^ a 



4 



sin (a) cos(77a) sin cos{r]P) 
' a ^ 



+ -77 + 2/ ^^dv 

4 ia(r,+2) ^Jan ^ 

1 /■'^ 



'a(r;+2) ^ ^ Jar/ 

+ t(»?-2) / — ^rf!^. 

la{ri-2) ^ 



Combining this result with (97) leads to (66). 

On the other hand, according to (65) and (19), we have 



Vr e M, 



1 f OJ U) 

/-i.V-? W = -- sinc^(^) sin^ (^) sin(wT) dw . 
In [61, p.459], an expression of sin^ (aa.) sin^(^^a.) sin (2r,x)dx ^j^jj (a, ^,77) e is given. Using this relation 

yields (67) when r > 0. The general expression for r e M follows from the oddness of 7^j_^h. 



Appendix XI 
Cross-correlation for the Franklin wavelet 

We have, for all r e R, 



1 /"^ 

7x,x^W = / |x(w)psin(a;r)rfw 



_ 2 r 

71" io 



°° sin8(a;) . ^ , 
J — sm(2u;rjaa;. 



/o 

After two successive integrations by part, we obtain 

4 s\vJ [uj) cos{ijj) sm.{2ujT) 

3^ 



7x,x«W=-— (4/ ... 







sin^fw) cos(2wr) , \ 
+r / ' -dio] 







2n /"^ sinS(w)sin(2wT) , 
-2(2 + t2) / n -duJ 







+ 16r /~ ^in^(^)cosHcos(2a;r) X _ 
io ^ 
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Standard trigonometric manipulations allow us to write: 

sin^(w) cos^(a;) sin(2u;r) =^ sin''(u;) ( sin(2rw) 

8 V 

- ^ sin (2(t + 2)io) - ^ sin (2(r - 2)a;)) 

sin*(a;) sin(2wr) =^ sin''(tj) sin (2(t + 2)uj) 

+ sin(2(r - 2)uj) - sin (2(r + l)a;) 
-4 sin (2(r - + 6sin(2ra;)) 
sin''(w) cos(w) cos(2wt) — j^ sm^{uj) sin (2(t — 2)uj) 

- sin(2(T + 2)w) + 2 sin (2(r + l)w) 
-2 sin (2(r- 

Inserting these expressions in (98) yields 

37r7x,^H(r) = Qo{t)J{t) - Qi{t)J{t + 1) - Qi{-t)J{t - 1) 

+ Q2(r)J(T + 2) + Q2(-T)J(T-2), (99) 



where (see [61, p. 459]) 

G R, J(x) = 2 / ^"^ sin(2wa;)(iu; 
Jo 



and 



3 

= —-a; In \x\ + (1 + a;) In |1 + x\ 

- (1 - x) In |1 - x| - In |2 + x| 

H —In 2 -a; 



Qo(t) = - 2, Qi(r) = y + 2t + 1, QsW = ^(r + 4)2. 



Simple algebra allows us to prove that (99) is equivalent to (75). 

On the other hand, |Ai(w)p can be viewed as the frequency response of a non causal stable digital filter whose 
transfer function is 

6(2-2+fli) 



+ 



(l + 2(^)^)(2 + ^) 
_ 2^3 / <2_+jv/3)_ _ 4(2 - ^/3) 
9 \z + 2 + V^ z + 2-^h 
7(2 + v^) - 4(1 + \/3)0 7(2 - \/3) - 4(1 - y3)z 



z2 + 2 + V3 z2 + 2- Vl3 

We next expand P^^ (z) in Laurent series on the holomorphy domain containing the unit circle, that is 

V3- 1 , , V3 + 1- 



^ r ^ I V3 - 1 11 V3 + i ~i 
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We thus deduce from the partial fraction decomposition of Pj^ {z) that 
= £ (-1)^(2 -x/3)l'=l.-'= 

fc= — OO 

+ 7 (-l)''(2-\/3)l'=U-2'= 

k= — oo 

oo 

+ 4(1 - ^/3) $^(-l)*=(2 - ^/3)'=(^2'=+l + ^"^'^-i)) . 

fc=0 

By identifiying the latter expression with X^^.^^ 7oi [fcj^"*^, (76) is obtained. 
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Fig. 1. A pair of primal (top) and dual (bottom) analysis/synthesis M-band para-unitary filter banks. 
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Asymptotic form of (r) as |t| -> 00 for Walsh-Hadamard wavelets. 
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Theoretical cross-correlation values in the dyadic case (d = 0). 
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Fig. 2. 2D cross-correlations using 3-band Meyer wavelets. Theoretical results (left); experimental results (right). 
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Theoretical values for the last cross-correlation sequence in the M-band Meyer case (d = 0). 
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Theoretical cross-correlation values in the Walsh-Hadamard case. 
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Cross-correlation ESTIMATES in the dyadic case (d = 0). 
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Cross-correlation ESTIMATES in the M-band case (d = 0). 
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-2.9936x10-=^ 


0.16111 


2 


-1.3788x10-=* 


0.58530 


-7.5797x10-=^ 


0.11985 


3 


1.0644x10-=* 


0.57418 


-7.6790x10-=^ 


0.10690 


Meyer 
5 -band 
e ^ 1/6 


1 


-7.2077x 10 " 


-0.60S62 


-3.45S8X10 - 


-0.16162 


2 


-3.2301x10"'' 


-0.58482 


-8.6826x10"^ 


-0.11844 


3 


-8.8877x10-=* 


-0.56937 


-9.3811x10"=^ 


-0.11512 


Meyer 
6-band 

e = 1/7 


1 


8.2632x10-* 


0.60806 


-3.7209x10-^ 


0.16215 


2 


-1.2448x10"=* 


0.58023 


-8.3257x10"=^ 


0.11022 


3 


5.5425x10"=* 


0.58196 


-8.4671x10"^ 


0.12368 


Meyer 
7-band 

e ^ 1/8 


1 


2.7863x10"* 


-0.60863 


-3.9804x10"=^ 


-0.16443 


2 


-5.9703x10-=* 


-0.57749 


-9.9056x10-^ 


-0.11228 


3 


1.8490x10-=* 


-0.58901 


-6.4289x10"=^ 


-0.13516 


Meyer 
8-band 
e = 1/9 


1 


-2.5084x10-* 


0.60811 


-4.1611x10-=^ 


0.16612 


2 


1.0345x10-=* 


0.57216 


-9.4172x10-=^ 


0.12014 


3 


-1.0777x10-^ 


0.56259 


-0.12183 


0.10776 



TABLE Vin 
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Wavelets \ t 


-3 


-2 


-1 





1 


2 


3 


Meyer 2-band 

. = 1/3 




9.1502x10^2 


-0.10848 


0.11800 


-0.11800 


0.10848 


-9.1502x10^2 


7.0491x10-2 




^8.1258x10^2 


0.10073 


-0.11434 


0.11924 


-0.11434 


0.10073 


-8.1258x10^2 


Splines 
order 3 


7^,0, 


-8.2660x10-2 


0.13666 


-0.18237 


0.18237 


-0.13666 


8.2660x10-2 


-4.5433x10-2 


7^,1. ^hW 


6.1604x10-2 


-0.10838 


0.16319 


-0.18941 


0.16319 


-0.10838 


6.1604x10-2 


Haar 


7^,0, 


-9.2323x10-3 


-2.2034x10-2 


-0.16656 


QMYll 


-0.16656 


-2.2034x10-2 


-9.2323x10-3 




-3.1567x10-3 


-1.9621x10-2 


0.35401 


-0.35401 


1.9621x10-2 


3.1567x10-3 


1.0758x10-3 


Meyer 
3-band 

e = 1/4 


7v,o.v,hW 


-8.4807x10^2 


8.8904x10-2 


-8.8904x10-2 


8.4807x10-2 


-7.7120x10^2 


6.6763x10^2 


-5.4904x10-2 




6.0944x10^2 


-7.2206x10-2 


8.1363x10-2 


-8.7347x10^2 


8.9428x10^2 


-8.7347x10^2 


8.1363x10-2 




-6.3891x10^2 


-7.4738x10^2 


-8.3192x10^2 


-8.8252x10^2 


-8.9297x10^2 


-8.6196x10^2 


-7.9333x10^2 


Meyer 
4-band 

e = 1/5 


7v,„.^hW 


6.5090x10-2 


-6.9156x10-2 


7.1274x10-2 


-7.1274x10^2 


6.9156x10-2 


-6.5090x10-2 


5.9394x10-2 




-6.2421x10-2 


6.7350x10-2 


-7.0473x10-2 


7.1543x10-2 


-7.0473x10-2 


6.7350x10-2 


-6.2421x10-2 




6.0949x10 - 


6.6274x10 - 


6.9878x10 - 


7.1473x10 2 


7.0939x10 - 


6.8312x10 - 


6.3804x10^2 


7v,„v,hW 


-6.5090x10-2 


6.9156x10-2 


-7.1274x10-2 


7.1274x10-2 


-6.9156x10-2 


6.5090x10-2 


-5.9394x10-2 



TABLE IX 

iNTER-BAND CROSS-CORRELATION VALUES FOR SOME WAVELET FAMILIES. WE RECALL THAT PROPERTY (12) HOLDS AND THAT, FOR 

M-BAND Meyer wavelets I^^^^h^ is zero when \m - m'\ > 1. 
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